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ABSTRACT 

Mathematics items developed to measure concept 
attainment for the topics of set theory, division, and expressing 
relationships were studied. A completely crossed design with 30 
concepts and 12 tasks was used. The items were administeiced to 196 
girls who had just completed the fifth grade and to 19!^ boys who had 
just begun the sixth grade. Conventional factor analyses were 
performed, separately for boys and girls, for concept scores and for 
task scores; these showed that all 30 of the concepts were measures 
of a single functional relationship existing among the concepts and 
that all 12 tasks were .mv>asures pf a single underlying ability or 
latent trait. Three*mode factor analyses indicated that there were no 
important concept-task interactions for the idealized person and thus 
the concepts and the tasks can be regarded as being two independent 
modes. For related documents in this series, see SE 015 462 and S£ 
015 *68. (Author/DT) 



It: *— T e chnical Re port No . 196 



P AN ANALYSIS OF CONTENT AND TASK DIMENSIONS OF MATHEMATICS ITEMS 

$'. DESIGNED TO MEASURE LEVEL OF CONCEPT ATTAINMENT 

§ 
I 

' ^ ■ By 

It Margaret 1. Harris and Thomas A. Rombei^ 

1 ■ ■ 



Report from the Project on 
A Structure of Concept Attainment Abilities 
Robert E. Davidson, Lester S. Golub, Herbert J, Klausmeier, 
Thomas A. Romberg, B. Robert Tabachnick, Alan M. Voelker 

Principal Investigators 
and 

The Quality Verification Program 
Mary R. Quilling, Director 



^ Wisconsin Research and Development 

I Center for Cognitive Learning 

I . The University of Wisconsin 

I Madison, Wisconsin 

i * ' - 

i November 1971 

I 

t - ■ 



i 

I 



1 



Published by the Wisconsin Research and Development Center for Cognitive Learning, supported 
in part as a research and development center by funds from the United States Office of Education, 
Department of Health, Education, and Welfare. The opinions expressed herein do not necessarily 
reflect the position or policy of the Office of Education and no official endorsement by the Office 
of Education should be inferied. 

Center No. C-03 / Contract OE 5-10-154 

3 



Statement of Focus 



The Wisconsin Research and Development CerUer for Cognitive Learning 
focuses on contributing to a better understanding of cognitive learning by chil- 
dren and youth and to the improvement of related educational practices. The 
strategy for research and development is comprehensive. It includes basic re- 
search to generate new knowledge about the conditions and processes of learn- 
ing and about the processes of instruction, and the subsequent development of 
research-based instructional materials, many of which are designed for use by 
teachers and others for cise by students. These meterials are tested and refined 
in school settings. Throughout these operations behavioral scientists, curricu- 
lum' experts, academic scholars, and school p<?ople interact, insuring that the 
results of Center activities are based soundly. on knowledge of subject matter 
and cognitive learning and that they are applied the improvement of educa- 
tional practice. 

This Technical Report is from the Project on the Structure of Concept Attain- 
ment Abilities in Program 1 . The general objectives of t.his project are to iden- 
tify basic concepts in language acts, mathematics, science, and social studies 
appropriate at a given grade* level; to develop tost s ^o measure achievement of 
these concepts; and to develop and identify reference tests for cognitive abil- 
ities. These will be used to study the relationships among learned concepts 
in various subject matter areas, cognitive abilities, and possibly, certain cog- 
nitive styles. The results of these will be a formulation of a model of structure 
of abilities in concept attainment. 
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Abstract 



Content and task dimensions of mathematics items were studied using 
factor analytic techniques. These items were developed to measure con- 
cept attainment using a completely crossed design with 30 concepts and 
12 tasks. Conventional factor analyses were performed, separately for 
boys and girls, for concept scores and for task scores. Three-mode factor 
analyses were performed. 

The main conclusions drawn from the results of the conventional factor 
analyses are that all 30 of the concepts are measures of a single functional 
relationship existing among the concepts, and that all 12 tasks are measures 
of a single underlying ability or latent trait. The three-mode results indicate 
that there are no important concept-task interactions for the idealized persons; 
thus it is reasonable to regard the concepts and the tasks as being two inde- 
pendent modes . 
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Introduction 



.The primary objective of the project en- 
titled "A Structure of Concept Attainment Abil - 
ities" (hereafter referred to as the CAA Project) 
is to formulate one or more models or structures 
of concept attainment abilities, and to assess 
their consistency with actual data. The major 
steps for attaining this primary objective were 
taken to be: 

1 . To identify basic concepts in language 
arts, mathematics, science, and so- 
cial studies appropriate at the fourth 
grade level, 

2. To develop tests to measure achieve- 
ment of these concepts, 

3 . To identify reference tests for cogni- 
tive abilities, and 

4. To study thfe relationships among 
learned concepts in these four sub- 
ject matter fields and the identified 
cognitive abilities. 

This paper contains a report cf the factor 
analytic study of the content and task dimen- 
sions of tlie mathematics items that were de- 
veloped as one aspect of Step 2. This study 
is a necessary intermediate step between 
Step 2 and Step 4; some reduction in the num- 
ber of concepts for each subject matter field 
from the 30 selected ones for which tests 
were developed is mandatory in order to be 
able to carry out Step 4, 



Nature of Mathematics Items ^ 

■ Concepts may be defined in one or more 
of four ways: (a) structurally, in terms of 
perceptible or readily specifiable properties 
or attributes; (b) semantically, in terms of 



synonyms or antonyms; (c) operationally, in 
terms of the procedures employed to distinguish 
the concept from other concepts; or (d) sxiom- 
atically, in terms of logical or numerical rela- 
tionships (Klausmeier, Harris, Ddvis, Schwenn, 
& Prayer, 1968). "A concept exists whenever 
two or more distinguishable objects or events 
have been grouped or classified together and 
set apart from objects on the basis of some 
common feature or property of each" (Bourne, 
1966, p.- 1). The concept of Bourne's defini- 
tion might be called a classificatory one and 
seems to be the same as the structural type 
discussed by Klausmeier et al. (1968). This 
is the type of concept with v^hich this project 
is concerned, and such a definition of a con- 
cept served as the basis for selection and 
analysis of subject matter concepts. 

Many different types of peiformance might 
be taken as the critical evidence that a student 
does or does not understand a gtven concept • 
Thus, as a part of this project it is necessary 
to have a schema for measuring understanding 
of concepts. Such a schema was developed 
by Prayer, Fredrick, and Klausmeier (1969) 
and was used by the CAA Project to assess 
concept attainment. The "Schema for Testing 
the Level of Concept Mastery" consists of 
13 types of questions, each involving a differ- 
ent task required of the examinee. The schema 
also allows for selection of an answer (mul- 
tiple-choice type questions) or for production 
of an answer (completion type questions). It 
was decided to use the first 1 2 tasks and a 
multiple-choice format for this project.. The 
12 tasks of the schema which were used are: 

1. Given the name of an attribute, select 
an example. of'the attribute. 

2. Given an example of an attribute, se- 
lect the name of the attribute. 

3. Given the name of a concept, select 



an example of the concept. 

4. Given the name of a concept, select 
a nonexample of the concept. 

5. Given an example of a concept, se- 
lect the name of the concept. 

6. Given the name of a concept, select 
the relevant attribute. 

?• Given the name of a concept, select 
the irrelevant attribute. 

8. Given the definition of a concept, se- 
lect the name of the concept. 

9. Given the name of a concept, select 
the definition of the concept. 

10. Given the name of a concept, select 
the supraordinate concept. 

11. Given the name of a concept, select 
the subordinate concept* 

12. Given the names of two concepts, 
select the relationship between them. 



Single- or compound-word classificatory 
concepts (those that are defined by attributes) 
in mathematics subject matter at the fourth 
grade level were identified. This task was 
subdivided into four steps: 

1. Identification of the major areas within 
the subject matter of mathematics, 

2. Selection of three of these major areas 
to be studied, 

3. Identification of classificatory con- 
cepts within each of these three major 
areas, and 

4. Random sampling of ten concepts from 
those identified for each of the three 
major selected areas. 

This yielded a total of 30 mathematics 
concepts to be studied by the project. A list 
is given in Table 1, by area, of the concepts 
identified and randomly selected for study. 
The areas are Sets, Division, and Expressing 
Relationships. A description of the procedures 
used to identify these concepts can be found 
in "Selection and Analysis of Mathematics 



Concepts for Inclusion in Tests of Concept 
Attainment" (Romberg, Steitz, & Frayer, 1971), 

The researchers of Project lOl, Situational 
Variables and Efficiency of Concept Learning, 
developed a system for analyzing a concept in 
preparation for developing items to measure 
the level of attainment of that concept (Frayer, 
Fredrick, & Klausmeier, 1969) . Since the pub- 
lication of that paper they, in cooperation 
with the researchers of the CAA Project, have 
refined their thinking and advanced this system. 
The refinements are discussed in "A Structure 
of Concept Attainment Abilities: The Problem 
and Strategies for Attacking It" (Harris, Harris, 
Frayer, & Quilling, in press). Briefly, a con- 
cept may be described in many ways: in terms 
of its criterial, relevant, and irrelevant attri- 
butes; its examples and nonexamples; its 
supraordinate, coordinate, and subordinate 
hierarchical relationships (theoretically deter- 
mined); and its lawful or other types of rela- 
tionships to other concepts. Knowledge of 
each of these kinds of information may be 
tested to determine a student's level of attain- 
ment of a concept. An analysis, along these 
lines, of each of the 30 sampled mathematics 
concepts which are being studied can be found 
in "Selection and Analysis of Mathematics 
Concepts for Inclusion in Tests of Concept 
Attainment" (Romberg, Steitz, & Frayer, 1971). 

Thus, using the analysis of a concept as 
the basis for appropriate content and the 1 2 
tasks of the schema as the basis for <^ppro- 
priate tasks , 1 2 items , one for each of the 
12 tasks, could be developed for each of the 
30 concepts making a total of 360 mathematics 
items. Actually, only 353 items were devel- 
oped for the purpose of measuring and assessing 
concept attainment in mathematics, as no sub- 
ordinate concepts were identified for 7 of the 
30 concepts studied; thus, there is no Task 11 
item for those seven concepts. A description 
of the procedures used in the development of 
these items, along with item and total score 
statistics (for concepts and for tasks) obtained 
for them for fifth grade boys and girls, can be 
found in "Measuring Mathematics Concept 
Attainment: Boys and Girls" (Harris & Romberg, 
in press). The items can be found in "Items to 
Test Level of Attainment of Mathematics Con- 
cepts by Intermediate -Grade Children" (Rom- 
berg & Steitz, 1971). • 

The following sections contain a discu&*^ 
sion of the study of the dimensionality of the 
two modes, concepts (content) and tasks, of 
this completely crossed design used to develop 
items to measure concept attainment in mathe- 
matics. 



Table 1 

Mathematics Concepts Categorized by Area 



Set Theory 



Division 



Expressing Relationships 



Cardinal Number 
♦Disjoint Sets 

Element 
♦Empty Set 
♦Equal Sets 
♦Equivalent Sets 

Intersection 
*Line 

Line Segment 

Non-Disjoint Sets 

Ordered Pairs 
♦Parallel Lines 
♦Plane 
♦Point 

Set 

Sets of Numbers 
Sjts of Points 
Skew ' 
♦Subset 

♦Subtraction - A way of 

looking at addition 
Triangular Numbers 
Union of Sets 
Universal Set 
Whole Number 



Algorithm 

Associative Property 
Closure Property 
Common Denominator 
Commutative Property 
♦Denominator 

* Density Property 
Distributive Property 

♦Division 
♦Factor 
♦Fraction 
Identity Property 
♦Mixed Fraction 
♦Multiplication 

* Numerator 
Order Property 
Partial Product 
Partial Quotient 
Partitioning 

♦Product 
♦Quotient 

Reciprocal Property 
♦Remainder 



Area 
♦Average 
Dozenal System 
Estimation 

Generating Sentences 
♦Graph 
Length 
Liquid 

Mathematical Sentences 
♦Measureinent 
♦Open Sentence 

Partial Sums 
♦Place iiolder 
♦Place Value 

Range 

Round Numbers 
♦Solution Set 
♦Standard Unit 
♦Statement 
♦We:ght 



♦Concepts randomly selected to be tested. 



Hypdthesized Factor Structures 

Alternative sets of factors were postulated 
for the mathematics concepts and for the tasks 
using mathematics content by viewing the con- 
cepts and tasks as two independent modes. 
Viowing them in this way is essentially hypoth- 
esizing that no important interactions exist 
between the two modes. 



Concepts 

The most general hypothesis is that just 
one common factor underlies the selected 
mathematics concepts. Next in the order of 
generality to specificity is that three common 
factors ar« present, one for each of the three 
major areas selected for study: Sets, Division, 
and Expressing Relationships. A more specific 
hypothesis is that theie may be two or more 
common factors for each of the three areas. 
A structure of the concepts within each of the 
three areas was not hypothesized. Instead, 



it was preferred to randomly sample concepts 
from each area and see what functional rela- 
tionshif>;j exist among those sampled concepts. 
It was &lt that this would eliminate bias in 
tlie picture of the dimensionality of the con- 
cepts imposed by theoretical relationships 
that may or may not exist in actuality. If 
attainment of concepts is highly specific, 
this approach may be detrimental as there 
may not be at least two 'measures (concepts) 
of a concept dimension included. There are 
some indications that the concepts are not 
this specific. For example, fairly reliable 
task scores obtained by totalling across *^\\e 
30 concepts for a single task were obtained. 
This indicates some degree of homogeneity 
among the concepts. 



Tasks 

The most general, hypothesis is that just 
one common factor or ability underlies the 12 
tasks. A more specific hypothesis is that 
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there are five underlying abilities: an ability 
dealing v/ith attributes (Tasks 1 and 2), one 
dealing with exdfnpnt s of a concept {Tasks 3, 
4, and 5), one ieiAled to the definition of a 
concept (Tasks 6, 7, 8, and 9), one related 
to hierarchical lelstionships (Tasks 10 and 11), 
and one for a relationship of a concept with 
another concept (Task 12). A slightly more 
specific hypothesis is that there are six abil- 
ities: the five just listed, with the exception 
that the ability related to the definition of a 
concept may be further specific to those tasks 
dealing with relevant and irrelevant attributes 



(Tasks 6 and 7) and those tasks dealing direct- 
ly with a definition (Tasks 8 and 9). 

These alternative sets of factors reoresent 
an a priori analysis of the math»j»matics con- 
cepts and the tasks when using :ria^hematics 
content, A major question to be answered in 
this study is the extent to which the obtained 
factors parallel such hypothesized analyses. 
Hote that, as discussed, several levels of 
specificity are postulated. Another question 
to be answered in this study is the extent to 
which the concepts and the tasks are inde- 
pendent as hypothesized. 
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Procedures 



Sub|ectt 

Pilot studies revealed that the concepts 
selected were very difficult for fourth graders. 
Thus, the decision was made to test fifth grade 
students with the concepts identified and sam- 
pled from the fourth tirade textbooks. The 
mathematics Items were administered during . 
early summer, 1970, to 196 girls who had just 
completed the fifth grade and to 195 boys who 
were just beginning the sixth grade during the 
fall of 1970 In the public school system of 
Madison, Wisconsin. The students were ran- 
domly selected from the population of all such 
girls and from the population of all such boys. 
The Madison Public School System made avail- 
able the Information concerning the population 
■ and used their computing facilities to designate 
the random sample for the girls. 

Initially, a random sample of 300 girls 
was drawn. Letters were sent to the parents 
of these students explaining the purpose and 
details of the testing, and Inviting thelrdaugh- 
ter to participate In the testing program. A 
stamped and addressed postcard was enclosed 
which the parents were asked to complete and 
return indicating whether or not they were 
willing to allow their daughter to participate. 
One hundred ernd two yes responses and 25 
no responses were obtained from the cards 
returned. Those parents who had not returned 
the card by a specified date were phoned. An 
additional 46 yes and 61 no responses were 
obtained by phone. Since this total of yes 
responses did not give as many subjects as 
were desired, an additional sample of 150 
girls was drawn at random . From this sample , 
56 jres^and 30 no responses were obtained by 
card. Thus, of the total sample of 450 students, 
203 jres^and 116 no responses were received; 
seven students did not complete the testing, 
which resulted in a total of 196 girls tested. 
These students were paid $7.50 for participat- 



ing. 

A random sample of 756 boys was drawn 
and letters were sent. By mall, 420 yes and 
87 no responses were obtained. Thirty-eight 
of the subjects did not complete the testing, 
resulting In 382 boys tested. Of this total, 
195 boys completed the mathematics and social 
studies Items; the others responded to language 
arts and science Items. As with the girls, the 
boys who completed the testing program were 
paid $7.50. 

Since the participation of all students 
comprising the random sample was Impossible 
to attain, test score and IQdata were obtained 
from the files of the Madison school system 
for both the school population and those par- 
ticipating students for whom the Information 
was available. Table 2 Includes the summary 
statistics for the population of fifth grade stu- 
dents In the public school system of the city 
of Madison during the school year 1969-1970, 
and for the boys and the girls who comprised 
the tested samples for the mathematics Items. 
The IQs were obtained In the fall of 1968 when 
the subjects were fourth graders using the 
Lorge-Thomdlke Intelligence Test, and the 
scores on the Iowa Tests of Basic Skills, given 
In grade equivalent scores, were obtained In 
the fall of 1969 when the subjects were fifth 
graders. 

Data on fathers* occupations were col- 
lected from the students using the Master 
Occupational Code of the United States Bureau 
of the Census. These data were tabulated and 
are presented In Table 3. 



Data Collection 

The data for the- girls were collected in 
two centrally located schools, one on the 
East side and one on the West side of the 
city, during five 2-hour dally sessions for 
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Table 2 

Test Data for Popultf.tion and Samples 



Test 




Population 


Boys 


Girls 


LiUive**i nornuiive inieiiiyenw»e 


y 


106 60 


105. 


95 


112 02 




s 




14. 


74 






N 


2605 


169 




191 


Iowa Basic Skills 












Vocabulary 


X 


5.53 


Q 

>J . 




5.75 




s 




1 

1 . 




1 .34 




M 

IN 




181 




1 ft? 


Reading 0:>mprehension 


X 


5.44 


5 • 


43 


5.84 


- 


s 




1 

1 . 


60 


1.46 




N 


25 20 


181 




1 87 


Language Skills 




5.24 


5. 


07 


5.74 




s 




1. 


43 






N 


2520 


181 




187 


Work-Study Skills 




5.46 


5. 


50 


5.70 




s 




1. 


31 


1.13 




N 


2520 


181 




187 


Arithmetic Skills 


T 


5.05 


5. 


08 


5.24 




8 




1. 


04 


.97 




N 


2520 


179 




187 


Composite 




5.35 


5. 


34 


5.65 




8 




. 1. 


22 


1.10 




N 


2520 


179 




185 



one week. Subjects could choose the week 
and the school in which they wanted to report 
for testing.. A one-week session was held at 
Hawthorne School from June 22 to June 26, and 
a one^eek session was held at Hoyt School 
firom July 13 to July 17. Each 2-hour session 
consisted of a 72 item "test" composed of 
mathematics items, a 72 item "test" composed 
of social studies items, and an activity break 
between the two of approximately 1/2 hour. 
The mathematics and the social studies items 
were given first on alternate days.' 

The data for the boys were collected in a 
similar manner except that it was done from 
mid-October to mid-November. Ninety of the 
boys who were attending Middle School for 
sixth grade were tested after school for five 
consecutive days at Schenk (October 19-23), 
Sennett (October 26-30), and Orchard Ridge 
(November 2-6) schools; those 105 elementary 
school boys who completed the testing were 
tested on three consecutive Saturday mornings 
(October 10, 17, and 24) at Rranklin, Longfellow, 
and Randall schools. 



The mathematics items were arranged in 
five 72 item "tests." The order of the items 
was assigned randomly over the 360 items. 
Two different random orders were used to col- 
lect the data: one for each school for the girls 
and one for each type of school for the boys. 
The items were arranged in five test booklets 
according to the random order. The students 
responded to the items by marking their chosen 
response directly on an answer sheet. The 
c.iswer sheets were read by machine and the 
responses punched onto data cards. The tests 
were given by experienced test administrators 
to groups of approximately 30 subjects each. 



Traotmont of the Dofa 

The treatment of the data consisted of two 
main procedures: reliability estimation and 
factor analysis. The data were analyzed sep- 
arately for each sample. Hoyt analysis of 
variance reliability estimates were obtained . 
for each of the 30 concept scores and each of 
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Table 3 

Distribution of Fathers' Occupations 



Occupation Boys Girls 

PROFESSIONAL, TECHNICAL, AND KINDRED WORKERS 

00. Accountant 

01 . Architect 

02. Dentist 

03. Engineer 

04. Lawyer, Judge 

05 . Clergyman 

06. Doctor 

07. Nurse 

08. Teacher, Professor 

09. Other Professional 

FARMER . 
1 1 . Farmer 

MANAGERS, OFFICIALS, PROPRIETORS, EXCEPT FARM 



21.. Owner of Business 2 

22. Manager, Official 12 11 

CLERICAL AND KINDRED WORKERS 

31 . Bookkeeper 

32. Receptionist 

39. Other Clerical and Kindred Workers 3 5 
SALES WORKERS 

49. Salesman ' 20 15 

CRAFTSMEN, FOREMEN, AND KINDRED WORKERS (SKILLED WORKERS) 

51. Craftsman, Skilled Worker 31 17 

5 2. Foreman 2 4 

53. Armed Services - Officer 1 1 

54. Armed Services - Enlisted Man 1 

OPERATIVES AND KINDRED WORKERS (SEMI-SKILLED WORKERS) 

61 . Truck Driver 10 5 

62. Operative in Factory 9 g 
69 . Other Operative and Kindred Workers 18 23 

PRIVATE HOUSEHOLD AND SERVICE WORKERS 

71. Fireman 13 

72. Policeman 1 

73. Other Protective Service Worker 1 

74. Practical Nurse, Nurse's Aide 2 

75. Private Household Workers 1 

79. Other Service Workers 14 13 



81 . Non-Farm Laborer 

82. Farm Laborer 

91 . Not presently in labor force 

99 . Not ascertained 



18 

1 R 



21 
99 



4 8 

13 22 



the 12 task scores for each group studied. 
Means and standard deviations for each of the 
scores were also computed. 



Factor Analysis 

Developing one item for each of the 1 2 
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tasks for each of the 30 selected concepts 
yields a 12 (tasks) by 30 (concepts) matrix 
consisting of the score for each of the 360 
items, one for each cell of the matrix, for 
each individual to whom the items are admin- 
istered. A completely crossed design exists 
and two types of total scores can be secured 
from this matrix: a total score for each of 
the 30 concepts (totalled across tasks) and 
a total score for each of the 1 2 tasks (totalled 
across concepts). Figure 1 is an illustration 
of such a matrix. Using this design to test 
concept attainment yields data cf a ti>ree- 
dimensional type, if more than one concept 
and more than one task are included. The 
three dimensions are concepts, tasks, and 
individuals. The application of conventional 
factor analysis procedures to such data pre- 
sents certain problems. As it has been used 
in the past, the researcher commonly collapses 
one dimension of the data, thereby losing 
information that is possibly very important. 
For example, common practice would be to 
use mean scores over the set of individuals 



to create a two-dimensional concept by task 
matrix which is then "factored, " 

Tucker*s (1966a, 1966b) three-mode factor 
analysis has made it possible to factor analyze 
three-dimensional data without the potential 
loss of information involved in collapsing a 
dimension. There are some problems, however, 
in applying the analysis to data collected using 
the concept by task design ,with one item per ceil. 
First, the data for a three-mode system are 
0-1 data with a single item per cell; thus, 
there is a reliability problem with single item 
variables. Second, the common factors in 
the system are of major interest and the pro- 
gram to which there is access is for a com- 
ponent type analysis. Third, as in ordinary 
factor analysis, the question of the number of 
factors (components) to extract is a difficult 
question to answer, and this information has 
to be input into the three-mode program. For 
these reasons the procedures outlined here 
were used for factor analyzing the mathematics 
data collected using the schema for testing , 
level of concept attainment. 



CONCEPTS 



TASKS 



Area 1 
1 2 10 



Area 2 
11 12 20 



Area 3 
21 22 30 



Total Score 
for Tasks 



12 



Total Score 
for Concepts 



Fig. 1. Item matrix for each individual. 
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Briefly, the strategy consists of perform- 
ing conventional factor analyses separately 
for the concepts and for the tasks to gain some 
insight into the interrelationships among the 
variables of a single mode. Tucker's three- 
mode factor analysis was then used to determine 
if there are any important interactions among 
the idealized persons (person factors) and the 
concepts or tasks. 

Conventional Factor Analyses. The orig- 
inal plans called for determining the comparable 
common factors, separately for the concepts 
and for the tasks, by using a strategy sug- 
gested by Hanris and Hanris (1970). This strat- 
egy is a way to determine those factors that 
are robust with respect to method— factors 
which tend to include the same variables across 
methods. Analyses were obtained using three 
initial factor methods: Alpha (Kaiser & Caffrey, 
1965), Hanris R-S^ (Hanris, 1962), and Unre- 
stricted Maximum Likelihood Factor Analysis 
(UMLFA) (Joreskog, 1967). These three meth- 
ods provide a factor solution with a statistical 
basis with the number of factors determined by 
a statistical test (UMLFA), and two factor 
solutions with a psychometric basis: one for 
a relatively small number of factors (Alpha) 
and one for a relatively large number of fac- 
tors (Harris R-S^) . AH three of the methods 
are independent of the scale of the variables. 
Derived orthogonal solutions were obtained 
for each of the three initial solutions using 
the Kaiser wormal varimax procedure (Kaiser, 
1958), and derived oblique solutions were ob- 
tained using the Harris-Kaiser independent 
cluster solution (Harris & Kaiser, 1964). 

The "right number of factors" question is 
one for which there is still no definitive answer. 
For matrices which yield about the same number 
of factors when different methods are used; 
Harris & Hanris (1970) suggest taking the com- 
parable common factors as the substantive 
results. Doing this, the number of factors 
can be more or fewer than the number of fac- 
tors for any single solution. This idea does 
not seem to be appropriate when the number 
of common factors obtained using different 
methods varies considerably, as is the case, 
for example, with the factoring of the mathe** 
matics concepts: for boys and girls respective- 
ly 2 each for Alpha, 8 and 7 for Harris R-S^, 
and 5 and 3 for UMLFA for the derived orthog- 
onal solutions; the derived oblique solutions 
yielded 2 each for Alpha, 7 each for Harris 
R-S2, and 5 and 3 for UMLFA for boys and 
girls respectively. These results will be pre- 
sented more explicitly and discussed in the 
next, section. 

•Alpha sometimes underfactors, and under- 



factoring is, according to Kaiser, "an unfor- 
givable sin." Harris R-S^ extracts a relatively 
large number of factors (Kaiser calls it delib- 
erate overfactoring); but this is no problem 
since derived orthogonal common factors retain 
the important things, get rid of the "garbage," 
and are in no way substantially affected by 
doing so (Kaiser, 1970). As an example, for 
the mathematics concepts, Hanris R-S^ ex- 
tracted 17 factors initially for the girls but 
the derived orthogonal solution trimmed these 
to 7 common factors. Kaiser (1970) advocates 
this "deliberate overfactoring" but says he 
wishes oblique transformations were robust 
to it which they are not. This problem was 
"solved" by not submitting the initial raw 
factor matrix to oblique rotation. Instead, 
the common factors of the derived orthogonal 
solution were taken as F and used to build R*. 
The Q obtained from a principal axes decom- 
position of R* then was submitted for oblique 
transformation. Thus: derived orthogonal com- 
mon factors = F; FF' = R*; R* = QD^Q* andthen 
this Q is transformed to give an oblique solu* 
tion. It may be pointed out here that getting 
derived oblique factors from the initial raw 
factor matrix or fix>m the Q obtained from R* 
will not make any difference if the number of 
initial factors and the number of derived orthog- 
onal common factors is the same; this is the 
case for the factors obtained for the mathe- 
matics concepts and tasks using both Alpha 
and UMLFA. Incidentally, Kaiser (1970) in the 
same paper advocates obtaining "Harris fac- 
tors" as they are model -free . What is named 
Harris R-s2 ig one of the set of "Harris factors. 

This discussion of the number of factors 
is an important one for this paper since it is 
necessary to input the number of factors for 
concepts and the number of factors for tasks 
Into the three-mode program. For these mathe- 
matics data the number of factors used was the 
number of Harris R-S^ derived oblique common 
factors. There are several reasons for this: 
(a) Harris R-S^ gives as many or more common 
factors as Alpha or UMLFA and greater specific- 
ity should allow any concept-tCiSk interactions 
to be more demonstrable, (b) the Harris R-S^ 
solutions "look" belter in terms of simple struc 
tare and lack of bipolarity, and (c) Henry Kai- 
ser (1970) now advocates that it is the best 
method. 

Three-Mode Factor Analyses . As was men- 
tioned earlier in the paper, three-mode factor 
analyses (Tucker, 1966a, 1966b) were performed 
to determine if there are any important interac- 
tions among the idealized persons and the con- 
cepts or tasks. Three problems were mentioned 
at that time. Two of them were "solved" by 
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doing the conventional factor analyses . The 
common factors In each of the two modes , 
concepts and tasks, were obtained and the 
number of factors (components) to Input Into 
the three-mode program for the two modes 
other than Individuals was determined. The 
third problem still remains— the reliability 
problem with single Item variables consisting 
of O-I type data. Also, a fourth problem exists 
which should perhaps be pointed out at this 
time. There are some missing data as can be 
seen In Table 4; Instead of 360 Items, there 
are only 353 for boys and 350 for girls. And 
^. empty cells cannot be tolerated in a three- 
mode factor analysis. To alleviate the latter 
two problems mentioned, single Item unreliabil- 
ity and missing data, a three-mode analysis 
was performed on two different forms of the 
same data In an attempt to gain Insight Into 
the existence of any Important concept-task 
Interactions. It might also be pointed out 
that the existing program has the capacity to 
handle only a product of I 20 for the two modes 
other than Individuals. Thus, we could not 
analyze our 30 concepts by 12 tasks, as this 
gives a product of 360. It would have been 
possible to expand the program's capacity to 
some extent but It would have been very diffi- 
cult. If not Impossible, to expand It to handle 
a product of 360. 

Conceptually, the 30 concepts were organ- 
ized by subject matter experts Into three areas 
within the subject matter field. A three-mode 
analysis was conducted using only three vari- 
ables for concepts. Each of these variables 
Is a composite of the Items for a single task 
across the ten concepts within a single area. 
Thus, the Input data for this analysis consisted 
of a 3 (concepts) by 12 (tasks) matrix of 36 
entries for each Individual. Each entry con- 
sisted of the total number correct of ten Items 
(or fewer In the cases of missing data) . The 
number of factors (components) for concepts 
Input for this analysis was taken as three. 
The number of factors (components) for tasks 
Input for this analysis was the number of 
derived oblique factors obtained for the Harris 
R-s2 method— three for boys and. two for girls. 
This analysis will be referred to as Type I 
three-mode analysis. Such an analysis should 
permit any task Interactions to be clearly evi- 
dent, as each task Is a separate entry; actually,, 
each task comprises three separate entries , one 
for each composite concept variable, 

A second three-mode analysis , to be re- 
ferred to as Type II, was conducted using all 
30 of the concepts but only three task variables 
for boys and two for girls. The task variables 



are composites of the Items for a single con- 
cept for given tasks. The composites formed 
for boys are: 

Task Variable A - Tasks 1, 3, 4, 5, 10, 
and 11 

Task Variable B - Tasks 1, 6, 8, and 9 
Task Variable C - Tasks 7 and 12 

The composites formed for girls are: 

Task Variable A - Tasks 1, 2, 3, 4, 5, 
6, 8, 9, 10, and 11 
Task Variable B - Tasks 7 and 12 

The formation of the composites was based 
on the derived oblique factors obtained for 
the Harris R-S^ method. A task was assigned 
to a composite on the basis of Its highest fac- 
tor coefficient. It Is realized that this Is essen- 
tially forming factor scores using a rather un- 
desirable method, but It was felt that since the 
intercorrelatlons of the task factors are very 
high (In fact so high that a reasonable Interpre- 
tation Is that the 12 tasks are all measures of 
the same latent ability). It would not be too 
detrimental. Also, It provided a way of forming 
composites based on experimental results rather 
than theoretical considerations to allow for 
greater specificity; an alternative would have 
been to Input only one variable for tasks which 
would consist of a composite for all 12 of the 
tasks. Thus, the Input data for this Tyoe 11 
three-mode analysis consisted of a 30 (con- 
cepts) by 3 or 2 (tasks) matrix of 90 or 60 
entries for each Individual. The three tasks, 
and thus 90 entries, are for the analysis of 
the boys* data and the two tasks and 60 entries 
are for the girls' . Each entry for the boys 
consisted of the total number correct of six, 
four, or two Items (or fewer In the cases of 
missing data) and each entry for the girls con- 
sisted of the total number answered correctly 
of ten or two Items (or fewer In the cases of 
missing data) . The number of factors (com- 
ponents) for tasks Input for this analysis was 
taken as three for boys and two for girls. 
The number of factors (components) for con- 
cepts input for this analysis was the number 
cf derived oblique factors obtained for the 
Harris R-S^ method— seven for both boys and 
girls. Such an analysis should permit any 
concept interactions to be clearly evident 
since each concept Is a separate entry; actu- ' 
ally, each concept comprises two or three 
separate entries, one for each composite task 
variable. Inhere still may be somewhat of an 
unreliability problem in this analysis, as some 
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of the entries consist of the total score for 
just two items . The results of treating the 



data in these various ways are presented and 
discussed in the following section. 
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Results and Discussion 



The means, standard deviations, and Hoyt 
reliability estimates obtained for the data col- 
lected during summer and fall of 1970 usingthe 
mathematics items developed are presented, 
separately for boys and girls, for total concept 
and total task scores. The intercorrelations 
and factor results for these data are presented 
and discussed, once again separately for boys 
and girls. 

Reliability Estimates and 
Test Statistia 

Table 4 contains the means, standard 
deviations, and Hoyt reliability estimates ob- 
tained for the data collected during summer 
and fall, 1970, using the revised items for 
total concept and total task scores. The data 
were analyzed separately for the 195 boys and 
the 196 girls. The key for the task scores ap- 
pears on the table; the key for the concept 
sv'ores can be found in Appendix A. For exam- 
ple. Concept 1 is Disjoint Sets, number 2 is 
Empty Set, number 3 is Equal Sets, etc. In 
general, the concept scores consist of 12 items 
each, and the task scores of 30 items each. 
Exceptions to this are noted in the footnotes. 

The mean scores for boys are generally 
lower than are the mean scores for girls. No 
conclusions can be drawn firom this, however, 
as the data for the girls were collected in 
early summer shortly after the school year of 
their fifth grade had ended and the data for the 
boys were collected in the fall -shortly after 
the school year of their sixth grade had begun. 
Thus, it cannpt be determined what, if any, of 
this difference is due to a sex difference and 
what is due to a time difference and possible 
forgetting factor. It should also be noted that 
the scores for Concepts 8, 15, and 22 are 
based on one more item for boys than they are 
for girls: Concept 15 has 11 and 10 items for 
boys and girls, respectively; Concepts 8 and 



22 each have 12 items for boys and 11 items 
for girls, making up the total score. The 
scores for Tasks 1, 2, and 9 are made up of 
30 items for boys but only 29 for girls. 

The standard deviations and Hoyt reliabil- 
ity estimates are generally higher for boys 
than they are .for girls. 

The reliability estimates are sufficiently 
high to warrant study of the dimensionality of 
these selected mathematics concepts and the 
tasks when using mathematics content. This 
is a major objective of the CAA Project and is 
the main puroose for developing these items 
to measure mathematics concept attainment. 

As was mentioned earlier, the subject 
matter specialists categorized the identified 
mathematics concepts into three major areas: 
Set Theory, Division— the inverse of multipli- 
cation, and Expressing Relationships. This 
was done on a theoretical basis. The data 
could be, and were, analyzed by area for task 
scores. Instead of a single total task score 
consisting of the score for that task type item 
for each of the 30 concepts, three different 
task scores were obtained for each of the 1 2 
tasks, consisting of the score for that task 
type item for each of the 1 0 concepts within 
a single area. The mean, standard deviation, 
and Hoyt reliability estimate for each of these 
36 scores, 3 areas by 12 tasks, were obtained. 
Table 5 contains the reliability estimates ob- 
tained for task scores by area and for the total 
across all 30 of the concepts. Spearman- 
Brown estimates for tripled test lengths (some 
are given at the bottom of Table 5 for compar- 
ison purposes) indicate that the area distinc- 
tions are not important ones; the reliability 
estimates for the total task score are about 
what would be expected from tripling the length 
of the test when the single ar§a reliability esti- 
mates are of the magnitude that were obtained. 
The factor results, which will be discussed 
later, also indicate that the area distinctions 
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Table 4 

Means, Standard Deviations, and Reliabilities for 
Mathematics Concept and Task Scores: Boys and Girls 



Concepts^' ^ 



No. 



Mean 
Boys Girls 



Standard Dev . 
Boys Girls 



Hoyt Rel . 
Boys Girls 



1 


6.51 


7.18 


2. 20 


2.01 


.48 


.42 


2 


7 .09 


8.06 


2. 66 


2.32 


.67 


.61 


0 


C 1 c 

D . i b 


7 OC 

/ . Zb 


Di 


9 XI 
Z. 41 


RX 
. 04 


R9 
. OZ 


A 
H 




7 AO 


9 OX 


9 OX 
Z . 04 


• bb 


Rn 
. OU 


C 


1 CI 


ft OX 


9 00 


9 m 
Z. Ui 


R1 
. 01 


xo 

. 49 


C 

V 


^\ 0C4- 

D . 




1 00 


1 ftn 
i . ou 


40 

t> 49 


XI 
.41 


7 


D . 40 




9 

£>• b*! 


9 dft 
Z . 40 


fi9 
. OZ 


R9 
. OZ 


Q 
O 


A ft? 


R c Oo. 
D . b 9+ 


9 XO 
Z . 49 


9 91 
Z . Zi 


R9 
. OZ 


CR 

. bo 




C QO 


C 1 n 


0 R9 
Z . DZ 


0 vl O 
Z. 49 


RO 
. 00 


C ft 

.59 


1 n 
i U 


D . D«3+ 


7 i1 Oo. 


9 RO 
Z. Do 


9 nx 
Z. U4 


7 1 


C Q 

.bo 


1 1 

?. 1 


R Rft 
D • DO 


ft 1 n 

0 . i u 


1 nn 


9 CO 
Z. b3 


7X 


RR 
. OO 


1 9 


7 1ft 
/ . i 0 


ft C 7 

0 . b / 


9 RR 
Z . DD 


9 94 


R7 
. 0/ 


R1 
. 01 


1 3 


c no 


b . 4o 


O CO 

2. bo 


2.55 


R O 

. oz 


Rn 
. oU 


14 


'"-^.69 


8.87 


2.61 


2.47 


.69 


.73 


15 


7.14+ 


7.28++ 


2.51 


2.14 


.69 


.68 


16 


7.33+ 


7.64+ 


2.49 


2.27 


.71 


.66 


17 


6.26f 


7.19+ 


2.39 


2.28 


.62 


.63 


18 


6.79 


7.12 


2.94 


2.90 


.75 


.76 


19 


6.20 


6.74 


2.69 


2.51 


.67 


.64 


20 


6.50 


7.65 


2.55 


2.45 


.64 


.64 


21 


5.66+ 


5.87+ 


2.19 


2.09 


.53 


.52 


22 


7.4i 


7.9 2+ 


2.29 


1.71 


.58 


.42 


23 


6.43 


7.11 


2.31 


2.18 


.57 


.55 


24 


5, 21+ 


6.24+ 


2.31 


2.29 


.58 


.60 


25 


6.65. 


7.97 


2.67 


2.39 


.65 


.62 


26 


5.65 


6.32 


2.58 


2.16 


.65 


.50 


27 


6.35 


7.41 


2.44 


2.33 


.61 


.61 


28 


6.83 


7.4 2 


2.58 


2.02 


.65 


.44 


29 


7.16 


7.84 


2.38 


2.16 


.59 


.55 


30 


8.55 


9.21 


2.52 


1.93 


.71 


.64 



Tasks^ 



Mean 



Standard Dev. Hoyt Rel. 



Boys 


Girls 


Boys 


Girls 


Boys 


Girls 


18.89 


19.34* 


5.41 


4.13 


.81 


.71 


18.14 


19.45* 


5.72 


5.12 


.82 


.80 


20.16 


22.25 


5.04 


4.00 


.80 


.73 


20.42 


22.79 


5.03 


4.00 


.79 


.73 


18.52 


21.05 


5.56 


4.34 


.82 


.75 


16.79 


19.44 


6.21 


5.56 


.84 


.82 


12.63 


12.51 


4.93 


4.61 


.73 


.70 


16.92 


20.40 


6.30 


5.86 


.85 


.85 


16.94 


18.54* 


6.02 


5.37 


.83 


.81 


15.28 


17.16 


5.33 


5.11 


.78 


.78 


11.85** 


13.65** 


4.49 


3.73 


.77 


.68 


12.25 


13.51 


4.13 


3.99 


.62 


.58 



Key for Tasks: 

1 Given name of attribute, select example. 

2 Given example of attribute, select name. 

3 Given name of concept, select example. 

4 Given name of concept, select nonexample. 

5 Given example of concept, select name. 

6 Given concept, select relevant attribute. 

7 Given concept, select Irrelevant attribute. 

8 Given definition of concept, select name. 

9 Given name of concept, select definition. 

10 Given concept, select supraordinate concept. 

11 Given concept, select subordinate concept. 

12 Given two concepts, select relationship. 



a The key for the concepts is given In Appendix A. 

b Scores consist of 12 items each except those marked as follows: + has 11 and ++ has 10. 
c Scores consist of 30 items each except those marked as follows: * has 29 and ** has 23. 



are not important ones . 



Facfor Analyses 

The correlation matrices for the concept 
scores upon which the factor analyses were 
based are given in Table 6 for boys and Table 7 
for girls. The intercorrelations of the task 
scores are given in Table 8 for boys and Ta- 
ble 9 for girls . 



1*4 



The intercorrelations of the concept scores 
are quite consistent in magnitude within the ma- 
trix for both boys and girls . The correlations 
for boys are typically in the .50s and .60s and 
for girls they are typically in the .40s and .50s. 
The reliability estimates obtained for the con- 
cept scores are generally higher for boys than 
for girls; typically in the . 50s and . 60s for 
boys and the .40s to .60s for girls. Thus, if 
the correlations were corrected for attenuation 
they would all be quite high. The lower correla- 
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Table 5 

Reliability Estimates for Task Scores by Area and Total for Girls 



Area 



Task 


Set Theory^ 


Division^ 


Expressing 
Relationships^ 


Total^ 


1 


.36 


.45+ 


.51 


.71* 


2 


.5 3+ 


.61 


.57 


80* 


3 


.46 


.53 


.49 


.73 


4 


.41 


.55 


.49 


.73 


5 


.49 


.59 


.49 


.75 


6 


.60 


.65 


.58 


.82 


7 


.42 


.54 


.33 


.70 


8 


.56 


.73 


.65 


.85 


9 


.62 


.63 


.50+ 


.81* 


10 


.56 


.66 


.40 


.78 


11 


. 29++ 


.45+++ 


.48++ 


.68** 


12 


.26 


.41 


.19 


.58 



3 Scores consist of 10 Items each except those marked as follows: 
+ has 9, ++ has 8, and +++ has 7. 



^Scores consist of 30 Items each except those marked as follows: 



* has 29 and ** has 23. 



For comparison, these are the Spearman-Brown estimates for 
tripled test length: 

Original Estlmatad 

.40 .67 

.50 .75 

.60 .82 

.65 .85 

.70 .88 
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Table 8 

Intercorrelations of Mathematics Tasks: Boys^ 



Task 


1 


2 


3 


4 


5 


6 


7 


8 


o 


2 


83 


















3 


81 


84 
















4 . 


78 


78 


76 














5 


84 


83 


83 


79 












6 


82 


82 


81 


75 


81 










7 


59 


62 


59 


59 


64 


68 








8 


84 


83 


81 


76 


83 


83 


69 






9 


83 


80 


80 


73 


80 


83 


65 


86 




10 


78 


78 


79 


74 


80 


80 


65 ; 


79 


77 


11 


76 


78 


77 


73 


77 


78. 


66 i 


79 


75 


12 


70 


70 


68 


62 


69 


73 


64 


70 


70 



Decimals have been omitted. 



Table 9 

Intercorrelations of Mathematics Tasks: Girls^ 



Task 


1 


2 


3 


4 


5 


6 


7 


8 


9 


2 


84 


















3 


82 


78 
















4 


74 


74 


73 














5 


76 


79 


78 


74 












6 


77 


79 


79 


73 


77 










7 


51 


53 


55 


48 


55 


61 








8 


.78 


82 


80 


78 


80 


64 


56 






9 


78 


bO 


78 


77 


77 


78 


54 


83 




10 


74 


76 


73 


VI 


74 


77 


54 


78 


71 


11 


72 


76 


73 


67 


76 


71 


51 


75 


72 


12 


59 


64 


67 


57 


64 


65 


59 


68 


66 



Decimals have been omitted. 



tions obtained are almost wholly associated 
with the concept scores which have low reli- 
ability estimates. 

The intercorrelations of the task scores 
are quite consistent in magnftude for boys and 
girls. They are in the .70s and .80s for both 
boys and girls except for Tasks 7 and 1 2. The 
correlations of Task 7 with the remaining tasks 
are in the .50s for girls and .60s for boys; the 
correlations of Task 1 2 with the remaining tasks 
are in the .60s for girls and .60s to low .70s 
for boys. Once again, it is interesting to look 

18 



at the reliability estimates for the task scores. 
They are generally higher for boys and are typ- 
ically in the .70s and .80s. Task 12, /however, 
has a reliability estimate of just .58 for girls 
and .62 for boys; Task 7 is in the low .70s for 
both boys and girls. Thus, as with the con- 
cepts, if the correlations were corrected for 
attenuation, they would almost all be very high. 



Conventional Factor Analyses 

The numbers of factors obtained for the 



24 



initial solutions and for the derived solutions, 
orthogonal and oblique » are given in Tables 10 
and 11 according to the numbers of common, 
specific, and null factors. A common factor 
is defined as one having at least two variables 
with coefficients greater than .30 (absolute); 
a specific factor has only one coefficient 
greater than .30 (absolute); and a null factor 
does not have any coefficients greater than 
. 30 (absolute) . The factors rotated for the 
derived oblique solutions were the orthogonal 
common factors obtained for that method. For 
this purpose a common factor was defined as 
one having at least two variables with coeffi- 
cients greater than .300 (absolute). 



Interpretation of Factor Results for Con* * 
cept Scores . The factor results for the con- 
cepts can be inteipreted at two levels. One 
level is a general one. A reasonable interpre- 
tation is that all 30 of the concepts are mea- 
sures of a single functional relationshio exist- 
ing among the concepts; this holds for both 
boys and girls. At least four things lead to 
such an interpretation. First, the intercorrela- 
tionsr of the 30 concepts are all quite uniform. 
They would probably fit a Spearman pattern 
fairly well; this indicates a single common 
factor. The correlations, if corrected for atten- 
uation, would all be quite high. The eigen- 
values of the correlation matrices obtained for. 



Table 10 

Numbers of Initial and Derived Factors for Concept Scores: Boys and Girls 



Initial D erived Orthogonal Factors Derived Oblique Factors 



Factor 


Factors 


Common 


Specific 


Null 


Common 


Specific 


Null 


Method 


B 


G 


B 


G 


B " 


G 


B 


G 


B 


G 


B 


G 


B G 


Alpha 


2 


2 


2 


2 


0 


0 


0 


0 


2 


2 


0 


0 


0 0 


Harris R-S^ 


18 


17 


8 


7 


3' 


3 


7 


7 


7 


7 


1 


0 


0 0 


UMLFA 


5 


3 


5 


3 


0 


0 


0 


0 


5 


3 


' 0 


0 


0 0 



Table 1 1 

Numbers of Initial and Derived Factors for Task Scores: Boys and Girls 



Initial Derived Orthogonal Factors Derived Oblique Factors 

Factor Factors Common Specific Nu 11 Common Specific Null 



Method 


B 


G 


B 


G 


B 


G 


B 


G 


B 


G 


B 


G 


B 


G 


Alpha 


1 


1 


1 


1 


0 


0 


0 


0 


1 


1 


0 


0 


0 


0 


Harris R-S^ 


5 


6 


3 


2 


0 


0 


2 


4 


3 


2 


0 


0 


0 


0 


UMLFA 


1 


2 


1 


2 


0 


0 


0 


0 


1 


2 


0 


0 


0 


0 



The derived orthogonal common factor 
results can be found in Appendices B-E; the 
derived oblique common factor results are pre- 
sented in Tables 12-15. Only coefficients 
greater than .30 (absolute) are included. The 
order of the factors for each solution is arbi- 
trary. The intercorrelations of the factors are 
included in the tables for the oblique solutions. 



both boys and girls are characterized by the 
first one being very large followed by a great 
drop in magnitude to the next ones which di- 
minish very gradually. Finally, the oblique 
factor intercorrelations are uniformly quite 
high, indicating only one second-order factor'. 
Such an interpretation is reasonable in terms 
of past studies, also. In the literature for 
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Table 12 ' 

Oblique Common Factor Results for Mathematics Concepts: Boys^ 



Alpha Harris R-S ^ UMLFA 



Concept 


A-1 


A- 2 


H-1 H-2 H-3 H-4 H-5 H-6 H-7 


U-1 


U-2 U-3 


U-4 U-5 


Area: Set Theory 




















I Disjoint Sets 


75 










38 






38 


2 Empty Set 


77 










34 






50 


3 Equal Sets 


53 






72 




95 








4 Equivalent Sets 


94 




51 






54 








5 Line 


43 


33 






113 








104 


6 Parallel Lines 




59 




77 










32 


7 Plane 


60 






— 




32 






32 


8 Point 


46 


32 




48 


46 








44 


9 Subset 


105 


-41 








87 








1 0 Subtraction 




79 






47 








36 


Area: Division 




















1 1 Denominator 


-48 


118 


97 -37 








1 Uv 




-40 


1 O ' TNI 1 _ 1 _ 

I 2 Division 




73 


43 




46 








62 


1 3 Factor 




63 


80 










7ft 


14 Fraction 




94 


86 33 








/U 




-35 65 


15 Mixed Fraction 


31 


54 


39 


9 




44 


0/ 




33 


16 Multiplication 




76 




49 


31 

w X 








67 


17 Numerator 


-34 


110 


83 














18 Product 




97 


60 








7ft 




19 Quotient 




79 




ftft 

oo 


-31 

w X 






1 1 
0 1 


60 


20 Remainder 




63 


36 












56 


Area: Expressing 




















Relationships 




















21 Average 




48 




79 




71 




31 


-40 . 


22 Graph 




54 






65 








52 


23 Measurement 




67 




42 










53 


24 Open Sentence 


44 




60 






34 






25 Place Holder 


32 


50 


43 


60 










127 


26 Place Value 


74 




100 






54 






66 


27 Solution Set 


72 




75 






45 






86 


28 Standard Unit 




62 


32 












29 Statement 




59 




74 










65 


30 Weight 




52 




35 


70 








60 



Intercorrelatlons 
of factors 2 
3 
4 
5 



91 



80 

80 84 

74 79 88 

83 83 88 83 

81 89 90 84 87 

81 86 90 88 88 91 



79 

79 81 

89 82 80 

91 87 83 92 



^ Includes those variables which have coefficients greater than 
Decimals have been omitted. 



30 (absolute) . 



20 



26 



Table 13 

Oblique Common Factor Results for Mathematics Concepts: Girls 



Alpha Harris R-S^ UMLFA 



O ft r» 1^ la nf 


r\ I 


A-2 






14 ..7 

rl— o 






rl— 0 


rl" / 


T1 1 




T1 Q 


Area: Set Theory 


























1 Disjoint Sets 


64 








58 












• 


35 


2 Empty Set 


43 


39 






40 














39 


3 Equal Sets 


47 


















56 






4 Equivalent Sets 


42 








92 














108 


5 Line 




63 . 














88 




36 




6 Parallel Lines 


48 










95 








60 






7 Plane 




46 










69 






47 






8 Point 




57 














32 


37 


35 








-34 






^7 

0 1 
















1 n QiihtrAPtinn 


80 


















7Q 






Area: Division 


























11 Denominator 




98 




85 














97 




1 2 Division 


56 










32 








58 • 






13 Factor 


88' 




93 














120 




-50 


14 Fraction 




75 




.62 














64 


39 


15 Mixed Fraction 




80 




37 














57 




16 Multiplication 


86 




58 














103 






17 Numerator 




92 




95 














92 




18 Projduct 


70 




53 














81 






19 Quotient 


72 




51 














73 






20 Remainder 


71 








48 










. 45 




38 


Area: Expressing 


























Relationships 


























21 Average 


88 


-34 


■ \ 














65 






22 Graph 


46 












69* 






44 






23 Measurement 


58 








. 80 














67 


24 Open Sentence 


39 














66 




61 






25 Place Holder 


57 








74 






31 




47 




34 


26 Place Value 


77 








94 










48 




44 


27 Solution Set 


52 








35 










56 






28 Standard Unit 


70 








39 




38 












29 Statement 


39 


41 








46 














30 Weight 




78 














45 




41 


31 



Inter correlations 
of factors 

83 



2 


91 


74 








87 


3 




84 


82 






89 


4 




.82 


78 


86 






5 




80 


79 


83 


80 




6 




75 


72 


75 


72 


71 


7 




78 


85 


86 


82 


84 74 



Includes those variables which have coefficients greater than .30 (absolute) . 
Decimals have been omitted. • \ 



Table 14 

Oblique Common Factor Results for Mathematics Tasks: Boys^ 



Task 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 



Given 
Given 
Given 
Given 
Given 
Given 
Given 
Given 
Given 
Given 
Given 
Given 



name of attribute, select example, 
example of attribute, select name, 
name of concept, select example, 
name of concept, select nonexample. 
example of concept, select name, 
concept, select relevant attribute, 
concept, select irrelevant attribute, 
definition of concept, select name, 
name of concept, select definition, 
concept, select supraordinate concept, 
concept, select subordinate concept, 
two concepts, select relationship. . 



Alpha 


Harris R-s2 


UMLFA 


M i 


H-1 


H-2 H-3 


U-1 


90 


47 


69 


91 


91 


95 




91 


90 


98 




90 


84 


110 




84 


91 


89 




91 


91 




45 


91 


72 




91 


72 


92 




81 


92 


89 




111 


90 


87 


80 




87 


86 


63 


39 


85 


78 




49 


77 



Intercorrelations of factors: 



2 
3 



98 

91 93 



a Includes those variables which have coefficients greater than .30 (absolute) 
Decimals have been omitted. 



Table 15 

Oblique Common Factor Results for Mathematics Tasks: 



Girls^ 



Task 



Alpha Harris R-s2 



UMLFA 



A-1 


H-1 


H-2 


U-1 


U-2 


87 


112 




125 


-39 


89 


100 




104 




88 


80 




84 




82 


97 




88 




88 


77 




73 




89 


62 




59 


32 


63 




83 




85 


91 


77 








88 


87 




„. -80 




85 


58 




55 


32 


83 


70 




67 




75 




75 




85 



1 

2 
3 

• 4 
5 
6 
7 
8 
9 
10 
11 
12 



Given 
Given 
Given 
Given 
Given 
Given 
Given 
Given 
Given 
Given 
Given 
Given 



name of attribute, select example, 
example of attribute, select name, 
name of concept, select example, 
name of concept, select nonexample. 
example of concept, select name, 
concept, select relevant attribute, 
concept, select irrelevant attribute, 
definition of concept, select name, 
name of concept, select definition, 
concept, select supraordinate concept, 
concept, select subordinate concept, 
two concepts, select relationship. 



Intercorrelations of factors: 



90 



91 



a Includes those variables which have coefficients greater than . 30 (absolute) . 
Decimals have been. omitted. 
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factor studies that include measures of achieve- 
ment, the results typically Indicate that achieve- 
ment measures are found on a single factor. We 
have here achievement measures for a single 
subject matter field which, conceptually at 
least, should be even more closely related than 
achievement measures from several different , 
areas of study. '/ 
The other level at which the factor results 
can be Interpreted Is a more specific one. The 
derived orthogonal factors are not very meaning- 
ful; they are not very Interpretable psycholog- 
ically. As can be seen from Tables 12 and 13, 
the oblique factors are very highly correlated; 
thus. Imposing the restriction of orthogonality 
on them gives results that are not very meaning- 
ful. Many of the variables are of complexity 

2, 3, and even higher In the orthogonal solu- 
ttofts. For example, for the two factors of the 
Alpha solutions, almost all of the concepts have 
coefficients greater than i30 on both of the fac- 
tors; for the UMLFA solutions, most of the vari- 
ables are of complexity 3 for the three factors 
obtained for boys and many are of complexity 

3, 4, and In one case, 5, for the five factors 
obtained for the girls . Even for the greater 
number of factors for the Harris R-S^ solutions, 
there are still a number of concept variables 

of complexity 2 and 3. Thus, at a more specific 
level, the only solutions which it makes any 
sense to interpret are the ob!ique ones. It must 
be remembered, however, that the correlations 
of these factors are all quite high. 

For matrices which yield about the same 
number of factors when different methods are 
used, Harris and Harris (1970) suggest taking 
the comparable common factors, those that are 
robust over method, as the substantive results. 
This idea does -not seem to be appropriate when 
the number of common factors obtained using 
different methods varies considerably, as is 
the case with the factoring of these mathemat- 
ics concepts: for boys and girls respectively, 
2 each for Alpha, 7 each for Harris R-S^, and 
5 and 3 for UMLFA. Thus , it seems the only 
appropriate thing would be to look at the results 
for each method individually. 

The results for the boys are given in Ta- 
ble 12. For these mathematical concepts, the 
Alpha results are the easiest to Interpret. The 
two factors replicate factors found in many 
other studies. Factor A-1 is an "abstract con- 
cepts" factor. It Inclvdes such concepts as 
Subset, Equivalent Se'.s, Solution Set, Place 
Value, etc. All are abstract concepts. Note 
that the Set concepts have large coefflclents 
on this factor as do* those concepts dealing 
with abstract relationships. The second Alpha 
factor, A-2, Includes concrete or operational 



concepts. All of the Division area concepts 
appear on this factor, as do all of the opera- 
tional concepts. More familiar or concrete 
concepts from geometry— Parallel Lines, Line, 
and Point— appear on this factor to some extent. 
Line and Point have larger coefficients on A-1, 
however. The items developed to measure 
these concepts were oriented more toward the 
abstract than the concrete. For example, the 
definition of Line is: A line has no end but 
does have a length and can be drawn using 
two points. 

The UMLFA method gives somewhat the 
same results. U-1 is the same abstract con- 
cepts factor as is A-1, The Set concepts still 
form the basis of this factor. U-2 is a frac- 
tions concept since it Includes Denominator, . 
Numerator, Fraction, and Mixed Fraction, and 
nothing else. U-3 is curious. It first seemed 
to be a multiplication factor since it Includes 
Factor and Product, and, to some extent. Quo- 
tient and Average. The curious thing is that 
the concepts Multiplication and Division do 
not appear on the factor. Thus, it Includes 
elements that are operated upon but not the 
operations themselves. U-4 seems to be a 
factor dealing with geometric and measurernent 
concepts. It Includes such things as Line, 
Point, and Graph which indicate geometric 
relationships, and Weight which is a kind of 
measurement. The concept of Measurement 
itself does not appear on this factor,, however. 
The appearance of Einpty Set and Subtraction 
on this factor is hard to explain. U-5 is an-^ 
other very difficult factor to explain . Large 
coefficients for Place Holder, Solution Set, 
Statement, and Measurement indicate a factor 
for mathematical sentences and their solution. 
Certainly the appearance of many of the Divi- 
sion afea concepts on this factor adds to this 
interpretation. The appearance of Disjoint 
Sets (with a small coefficient only) and the 
failure of Open Sentence to be Included are 
unexplalnabie, however. 

The Harris R-S^ solution is, in general, . 
much more difficult to Interpret than the others. 
H-1 is a doublet factor for the two concepts 
Factor and Product. H-2 is the same Fractions 
factor as U-2. From H-3 on, the factors are 
more difficult to Interpret. Place Value and 
Solution Set clearly indicate that H-3 is a 
numeric factor with relatively small coefficients 
for Place Holder, Division |. Remainder, and 
Fraction. There seems to be no rationale for 
the appearance of Disjoint Sets, Equivalent 
Sets, Open Sentence, and Standard Unit on 
H-4. There are no immediately obvious rela- 
tionships for the concepts which appear on 
H-5. Looking closer, the three main concepts 



ERIC 



23 



23 



on the factor— Equal Sets, Parallel Lines, and 
Average— could perhaps indicate some kind of 
"common ground" type of relationship. Point 
and Mixed Fraction which appear with some- 
what smaller coefficients do not fit into such 
an interpretation, however. Once again, there 
seems to be no good interpretation for H-6 
which includes Quotient, Multiplication, State- 
ment, Place Holder, Measurement, andWeight. 
Similarly, the concepts which appear on H-7— 
Line, Point, Empty Set, Subtraction, Graph, 
Weight, Division, and Multiplication— do not 
seem to be related conceptually. It is interest- 
ing to note that the concepts which are names 
of operations and those which are elements 
operated upon do not appear on the same fac- 
tors; see Factors H-I, H-6, and H-7. This 
was the case for Multiplication in the UMLFA 
solution, but Division and its elements did 
appear on the same factor, U-5 . This does 
not hold for the girls as will be seen later. 

The results for the girls are given in Ta- 
ble 13 and will be interpreted here. Once again, 
the Alpha results are the easiest to interpret. 
The two Alpha factors parallel the two obtained 
for the boys but with some rather striking differ- 
ences. A-1 seems to be the abstract concepts 
factor and A-2 the concrete or operational con- 
cepts factor. However, the abstract concepts 
factor includes many of the 30, concepts and is 
much more inclusive than it is for boys; for 
boys, the concrete or operational concepts fac- 
tor included more concepts than the abstract 
one. Unlike the boys, for the girls the Divi- 
sion area concepts split on the two factors, 
those for fractions appearing on A-2 and the 
remaining ones on A-l; also unlike the boys, 
the concepts for the area of Expressing Rela- 
tionships almost all appear on A-l , Perhaps 
at this fifth grade level more mathematical con- 
cepts are at an abstract level for girls but at a 
concrete or operational level for boys. 

The UMLFA method yiislded three factors 
for girls as compared to five for boys. U-1 
seems to be essentially the same abstract con- 
cepts factor as A-l. It is still very broad, in- 
cluding many of the concepts in each of the 
three areas. The main difference between A-l 
and U-1 is that some of the Set concepts and 
Measurement split off and form another factor, 
U-3. U-2 is basically the Fractions factor. 

As with the boys, Hanris R-S^ results are 
much more difficult to interpret than the others. 
The first three factors are quite clear; the re- 
maining ones are not so clear. H-1 appears 
to be a multiplication factor including the con- 
cepts Factor, Product, Multiplication, and 
Quotient. The concepts for both the operation 
and the elements operated upon appear on this 



factor; this type of result is unlike the results 
for boys in this respect. It is curious that 
Quotient appears on this factor but not Remain- 
der or Division. H-2 is the factor for the frac- 
tions concepts. H-3 appears to be the general 
abstract concepts factor, though it is not as 
inclusive as it is for the Alpha and UMLFA 
solutions . It includes all of the Set concepts 
except Equal Sets and most of the abstract 
concepts from the Expressing Relationships 
area. There seems to be no rationale for ex- 
plaining H-4. Two of the three operations 
studied. Subtraction and Division, appear 
here, but they seem unrelated to the other ' 
two concepts, Parallel Lines and Statement. 
H-5 may be interpreted as including concepts 
that deal with less familiar geometric concepts 
since the two main concepts on the factor are 
Plane and Graph. H-6 is a doublet for Open 
Sentence and Place Holder. The relationship 
here seems to be that a place holder is used 
in an open sentence. H-7 is a curious factor 
with Point and Line both appearing on it, but 
with coefficients of quite different magnitude. 
The other two concepts that appear on H-7 are 
Weight and Subtraction. 

It is interesting to point out that the fac- 
tor for "abstract concepts" appeared for all 
three of the methods for the girls but only for 
the Alpha solution for the boys. 

It is evident from the factor results that 
the three area distinctions are not functional; 
thus, the hypothesis that mathematical con- 
cepts are functionally related according to the 
three conceptually-determined major content 
areas must be rejected. 

A word of caution. Too much emphasis 
should not be placed on the distinctions just 
discussed, as the interconrelations of the fac- 
tors are quite high. The abstract and concrete 
factors of the Alpha solution are correlated ,91 
for both boys and girls. There are only four 
concepts that are of complexity 2 for girls and 
7 for boys . Of these , two are bipolar for girls 
and three are bipolar for boys. As one would 
expect, as the results become more specific 
(more factors) the factors are less correlated. 
However, for the seven factors of the Harris 
R-S2 solution, the correlations are in the .70s 
and .80s for girls and the high .70s to low 
.90s for boys; these correlations are quite 
high, especially considering that there are 
very few variables on many of the factors. 

It may b'e well to insert a reminder here 
that the orthogonal solutions are not very 
meaningful psychologically, since the com- 
plexity is greater than 1 for most of the con- 
cepts; most of the concepts appear on more 
than one factor. 
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The most interesting aspect of studying 
these mathematics concepts is yet to come: 
the study of the relationships of selected math** 
ematics concepts with selected concepts from 
the other three subject matter fields being 
studied (language arts, science, and social 
studies) . This is Step 4 of the objectives of 
the CAA Project as stated on Page 1. 

Interpretation of Factor Results for Task 
Scores . As with the concepts, the factor re- 
sults for the tasks can be interpreted at two 
levels. One level is a general one; alM 2 of 
ttio tasks are measures of a single underlying 
ability or latent trait. This seems to be the 
vr/jst reasonable interpretation for the' tasks 
since the intercorrelations of the oblique fac- 
tors are very high when more than one factor 
is yielded . All of the reasons for a general 
interpretation for the concepts apply for the 
interpretation of the tasks: (a) the intercorre- 
lations are all quite high and quite uniform— 
they would fit a Spearman pattern fairly well, 
(b) the correlations corrected for attenuation 
would all be very high, (c) the^eigenvalues 
of the correlation matrices are characterized 
by the first one being very large followed by 
a great drop in magnitude to the next ones, 
and (d) the factor intercorrelations are uniformly 
very high, indicating only one second-order 
factor. 

At a more specific level, only the oblique 
factor results are psychologically meaningful. 
These results are given in Table 14 for boys 
and Table 15 for girls. 

For the boys, both Alpha and UMLFA 
yielded only one common factor. The factor 
coefficients for both of these solutions are 
uniformly very high. The Hanris R-S^ solution 
yielded three factors, but H-1 and H-2 are 
correlated .98; it is rather senseless to try 
to make any distinction between these two 
factors. H-3 is correlated .91 and .93 with 
H-1 and H-2 respectively. It basically in- 
cludes Task 7 and Task 1 2. Both of these 
tasks go beyond the characteristics of the 
concept itself and involve relationships with 
other concepts. Task 1 2 does this directly; 
Task 7 does it by requiring that the student 
distinguish between attributes that are neces- 
sary for an exemplar to be identified as an 
exemplar of that particular concept (relevant 
attributes) and those that are an attribute of 
the concept but are not necessary to identify 
it as an exemplar of that particular concept 
(irrelevant attributes) • For example, a rele- 
vant attribute of Equivalent Sets is that they 
contain the same number of members; what 
those members, are is irrelevant. What the 



members are is a relevant attribute for Equal 
Sets,, however; the members of two or more equal 
sets must be identical. Irrelevant attributes 
often identify conciepts that are conceptually sub- 
ordinate to a given concept. In this sense. Task 7 
involves relationships with other concepts. Task 
6 is essentially the reverse of Task 7, however. 
It requires selecting a relevant attribute from 
irrelevant ones while Task 7 requires selecting 
an irrelevant attribute from relevant ones. 

For the girls. Alpha yielded just one factor 
while Harris R-S2 and UMLFA both yielded two 
factors. They are essentially the same factors 
as the two somewhat different ones of the Har- 
ris R-s2 solution for the boys. H-1 and U-1 
include all of the task variables except Task 7 
and Task 12. These two tasks comprise H-2 
and are the main variables on U-2. 

As with the concepts, the most interesting 
aspect of studying these tasks using mathematics 
content will be to see the relationships to these 
same tasks when language arts, social studies, 
and science concepts are used as content. 



Three-Mode Factor Analyses 

As was discussed earlier, a three-mode 
factor analysis was performed on two different 
forms of the same data to gain insight into the 
existence of any important concept -task inter- 
actions for the idealized .persons. Performing 
conventional factor analyses on the two modes, 
concepts and tasks, separately is essentially 
hypothesizing that there are no interactions . 
The three-mode analyses were performed to 
determine whether this hypothesis is a tenable 
one. 

The Type I three -mode analysis is the analy- 
sis of the 12 tasks and the three composite con- 
cept variables; Type II is the analysis of the 
two (girls) or three (boys) composite task vari- 
ables and the 30 concepts. Type I was per- 
formed to permit maximum task interactions to 
be evident; Type II to permit maximum concept 
interactions. 

The core matrix obtained for each analysis 
is the only piece of the three-mode analysis of 
interest here since it contains the idealized per- 
son components by task components by concept 
components. Hence, it is in this matrix that 
any interactions are seen. The core matrices 
obtained for Type I and Type II analyses are 
presented in Table 16, for boys and in Table 17 
for girls. Only those idealized plerson (core) 
components that have one or more coefficients 
greater than .50 (absolute) are included in the 
tables; the number of core components obtained 



in each of the analyses was equal to the pro- 
duct of the number of components for the two 
modes other than Individuals. The variables, 
comprising the task components are given In 
footnotes on each of the tables. The variables 
comprising the Type I concept components are 
the ten concepts In each of the three areas. 
The concept components for the Type 11 analy- 
ses bear some resemblance to the Harris R-S^ 
factors which were the basis for the number of 
components to be extracted but they are much 
more specific. Most of them have only two 
or three variables with coefficients greater than 
.30 (absolute) . • 

Both Type I and Type II analyses for the 
boys Indicate that there Is only one Idealized 
person type— there Is just one major core com- 
ponent. As Indicated by the Type I analysis, 
persons respond similarly to the concepts of 
the three different areas; the Type II analysis 
Indicates some slight differentiation among 
the concepts. Both analyses Indicate that a 
person who scores well tends to do less well 
on Tasks 7 and I 2; he does poorly on Task 7 
for Area 2 concepts and average on concept 
component 4 In the Type II analysis, which 
Is a component comprised essentially of con- 
cept variably I (Disjoint Sets). A person with 
low scores for core component I would tend 
to perform better on Tasks 7 and 1 2 than on 
the remaining tasks. In the Type I analysis 
there are no other coefficients greater than 
.75 (absolute). Minor variations in response 
patterns for the Idc^iUrrod persons can be seen 
In Table 16. In the Type II analysis there Is 



just one other coefficient that Is greater than 
.75 (absolute). Idealized person type 3 tends 
to do less well on concept component 7; this 
is essentially the same as the H-1 factor for 
lask component 3 which Is comprised of Tasks 7 
and 12. Minor variations In response patterns 
for the idealized persons for the Type II analy- 
sis can be seen In Table 16. 

The three-mode results for the girls are 
essentially the same as for the boys; there Is 
just one major core component Indicating just 
one Idealized person type. As with the boys, 
.a person with high scores on this core com- 
ponent does less well on Tasks 7 and 12 than 
on the other tasks. She responds similarly to 
the concepts of the three different areas with 
some slight variations among the concepts as 
Indicated by the Type II analysis. In the Type 
I analysis there Is just one coefficient greater 
than .75 (absolute); idealized person type 2 
tends to do poorly on Area 2 concepts for Tasks 
7 and 12. There is one other coefficient greater 
than .75 (absolute) In the Type II analysis; 
Idealized person type 3 does poorly on concept 
component 5 which Is essentially concept vari- 
able 30 (Weight) for Tasks 7 and 12. All other 
slight variations can be seen In Table 17. For 
the Type II analysis these other slight variations 
In response patterns are limited to task compo- 
nent 2 which Is comprised of Tasks 7 and 12. 

The results of the three-mode factor analy- 
ses support the hypothesis that there are no 
Important concept-task Interactions for the 
Idealized persons. Thus It Is reasonable to 
regard these two modes as Independent. 
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Table 16 
Three-Mode Core Results: Boys 



Type I 
Concept Components 

Idealized Task Area Area Area 
Persons Components^ 1 2 3 



1 


2.43 


2.41 


2.33 


2 


.78 


-.71 


.52 


3 


,64 


.52 


.64 


1 


.27 


.18 


.01 


2 


-;25 


.42 


-.71 


3 


.16 


-.29 


-.35 


1 


.61 


-.08 


-.63 


2 


.24 


-.14 


.20 


3 


. 01 


-.11 


-.26 


1 


-.03 


-.16 


-.08 


2 


-.26 


.08 


-.11 


3 


.58 


.25 


.10 



Type II 

Idealized Tsftk Concept Components 



Persons 


Components^ 


1 


2 


3 


4 


5 


6 


7 


1 


1 


.72 


1.61 


.97 


.58 


2.41 


.89 


1.11 




2 


.61 


1.49 


1.07 


.87 


2.35 


.77 


1.07 




3 


.27 


.69 


.43 


-.04 


1.42 


.71 


.60 


2 


1 


-.19 


-.10 


.1.3 


-.26 


.57 


.19 


-.14 




2 


.03 


-.38 


-.06 


-.02 


.30 


.03 


-.06 




3 


-.49 


-.56 


.46 


-.44 


-.23 


-.06 


-.07 


3 


1 


.14 


.09 


-.01 


-.13 


.09 


-.02 


-.24 




2 


.18 


-.19 


-.06 


.21 


.18 


.21 


-.14 




3 


.02 


-.22 


.50 


.06 


-.16 


.13 


-.78 


4 


1 


-.05 


.21 


-.22 


.01 


.06 


-.23 


-.14 




2 


-.08 


.04 


.11 


.07 


.02 


-.22 


-.35 




3 


-.25 


-.07 


-.26 


.55 


.43 


.15 


-.19 


5 


1 


-.06 


-.11 


.05 


-.03 


-.11 


.12 


.06 




2 


.11 


-.12 


.18 


-.10 


-.10 


-.02 


.11 




3 


-.08 


-.52 


-.07 


-.01 


-.01 


.28 


-•32 



^Variables comprising task components: 

Type 1:1- Tasks 1-6, and 8-11 

2 - Task 7 

3 - Task 12 

Type II: 1 - Tasks 2- 5, 10, 11 

2 - Tasks 1 , 6, 8, 9 

3 - Tasks 7, 12 



Table 17 
Three-Mode Core Results: Girls 



^ Type I 
Concept Components 



Idealized Task Area Area Area 
P orsons Components^ 1 2 3 



1 


1 


2>33 


2,27 


2.32 












2 


,93 


.58 


.76 










2 


1 


.33 


.17 


.02 












2 


-.33 


-^83 


-.58 










3 


1 


-.56 


.50 


.14 












2 

• 


-.14 


-.12 


.09 














• ■ 






Type II 








Idealized 


Task 






Concept Components 






Persons 


Components^ 


1 


2 


3 


4 


5 


6 


7 


1 


1 • 


2/12 


1.46 


1.08 


1.56 


.52 


1.62 


1.24 




2 


. 1.16 


.21 




.69 


. 23 


.27 


.89 


2 


1 


.27 


.22 


.11 


-.07 


-.21 


.14 


.34 




2 


-.41 


-.46 


-.34 


-.63 


-.38 


-.65 


.01 


3 


1 


-.34 


.15 


-.13 


.14 


.14 


.17 


.06 




2 


-.38 


-.05 


-.09 


.26 


-.80 


.35 


.47 


4 


I' 


.00 


-.07 


-.23 


.08 


.03 


.15 


.11 




2 


-.18 


.58 


.36 


-.38 


.02 


-.11 


-.02 


5 


1 


-.23 


.00 


.15 


-.08' 


.06 


.13 


.15 




2 


-.31' 


-.34 


.66 


-.14 


.17 


.24 


.11 


6 


1 


.00 


-.10 


.16 


-.10 


-.14 


-.04 


-.12 




2 


.07 


-.04 


.38 


.08 


-.14 


-.56 


.28 



Variables comprising task components: 

Types I and II: 

Component 1 - Tasks 1, 2, 3, 4. 5, 6, 8, 9, 10, and 11 
Component 2 -Tasks 7, and 12 



IV 

Summary and Condusions 



The primary objective of the project en- 
titled "A Structure of Concept Attainment Abil- 
ities" is to formulate one or more models or 
structures of concept attainment abilities » and 
to assess their consistency with actual data* 
This paper contains a report of the factor analy- 
tic study of the content and task dimensionsof 
the mathematics items* 

Mathematics items to measure concept 
attainment were developed using a completely 
crossed design utilizing 30 concepts and 12 
tasks * The mathematics items were adminis- 
tered during the- summer of 1970 to 19 6 girls 
who had just completed the fifth grade and 
during the fall of 1.970 to 195 boys who had 
Just begun the sixth grade . 

Two types of total scores were secured 
from the students' responses to the mathematics 
items— a total score for each of the 30 concepts 
(totalled across tasks) and a total score for 
each of the 12 tasks (totalled across concepts)* 
Means, standard deviations, and Hoyt reliabil- 
ity estimates were obtained for each of the 30 
concept scores and each of the 12 task scores 
for each of the groups studied* 

Conventional factor analyses were per- 
formed separately on the intercOTrelation ma- 
trices obtained for the concepts and for the 
tasks for the boys and the girls* Analyses 
were obtained using three initial factor methods: 
Alpha (Kaiser & Caffirey, 1965), Harris R-S^ 
(Harris, 1962), and Unrestricted Maximum 
Likelihood Factor Analysis (Joreskog, 1967)* 
Derived orthogonal solutions were obtained 
for each of the three initial solutions using 
the Kaiser normal varimax procedure (Kaiser*, 
1958) and derived oblique solutions were ob- 
tained using the Harris-Kaiser independent 
cluster solution (Harris & Kaiser, 1964)* 

Three-mode factor analysis (Tucker, 1966a, 
1966b) was performed on two different forms of 
the same data to determine whether there are 
any important interactions among the idealized 
persons and the concepts and/or tasks* 



The conventional factor results for the 
concepts yielded two or more orthogonal fac- 
tors tor the various methods* The concept 
variables are almost all of complexity 2, 3, 
and even greater on these factors, however* 
The oblique results tend to yield simple struc- 
tures but the oblique factors are very highly ^ 
cOTrelated; thus, the main conclusion is that 
all 30 of the concepts are measures of a sin- 
gle functional relationship existing among 
the concepts* This holds for both boys and 
girls * 

As with the concepts, the most reasonable 
Interpretation for the tasks is that all 12 of the 
tasks are measures of a single underlying abil- 
ity or latent trait. The intercorrelations of the 
oblique factors are extremely high when more 
than one factor is yielded* 

The results of the three-mode factor analy- 
ses support the hypothesis that there are no 
important concept -task interactions for the 
idealized persons* Thus, it is reasonable to 
regard these two modes as being independent* 

The most interestbig aspect of studying 
these mathematics items will be to see how 
they are related to concepts from three other - 
subject matter fields (language arts, science, 
and social studies) and to general cognitive 
abilities* The data for such a study will be 
collected during summer, 1971 * Even though 
a reasonable interpretation is that there is 
only a single common factor for the 30 con- 
cepts, the most specific results obtained 
were used to determine what mathematics con- 
cepts to include in the summer, 1971, study* 
This should permit maximal demonstration of 
relationships with concepts from other subject 
matter fields* The two concepts with the high- 
est coefficients on each of- the Harris R-S^ 
factors for both the boys and girls were se- 
lected* On this basis a total of 18 mathematics 
concepts were selected for further study* These 
concepts are: Disjoint Sets, Equivalent Sets, 
Line, Parallel Lines, Plane, Subtraction, 
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Denominator, * Factor, Fraction, Product, 
Quotient, Average, Graph, Open Sentence, 
Place Value, Solution Set, Statement, and 
Weight. Even though the most reasonable 
interpretation for the tasks is that there is 



a single common factor, all 12 of the tasks 
will be included in the summer, 1971, study 
in order to have a reliable concept score 
(totalled across the 12 tasks for a single 
concept). 
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Appendix A 
Key for Concepts in Numerical Order 



1 Disjoint Sets 

2 Empty Set 

3 Equal Sets 

4 Equivalent Sets 

5 Line 

6 Parallel Lines 

7 Plane 

8 Point 

S Subset 

10 Subtraction 

11 Denominator 

12 Division 

1 3 Factor 

14 Fraction 

15 Mixed Fraction 

16 Multiplication 

1 7 Numerator 

18 Product 

19 Quotient 

20 Remainder 

21 Average 

22 Graph 

23 Measurement 

24 Open Sentence 

25 Place Holder 

26 Place Value 

27 Solution Set 

28 Standard Unit 

29 Statement 

30 Weight 



. ^ Appendix B 
Orthogonal Common Factor Results for 
Social Studies Concepts: Boys^ 

Alpha Harris R-S^ UMLFA 



Concept 


A-1 


A-2 


H-1 H-2 H-3 H-4 H-5 H-6 H-7 H-8 


U-1 


U-2 U-3 U-4 U-5 


Area: Set Theory 






























1 Disjoint Sets 




56 










54 








47 








2 Empty Set 


44 


67 




44 


47 












55 




44 




3 Equal Sets 


. 52 


60 


32 




36 






49 




35 


63 


39 






4 Equivalent Sets 


31 


66 






35 




41 








56 




32 




5 Line 


51 


54 




5o 














38 




60 




6 Parallel Lines 


58 


45 


32 


34 








49 




36 


41 


36 


34 




7 Plane 


44 


58 








36 


34 








45 


36 


34 




8 Point 


52 


56 




39 








38 






47 


31 


41 




9 Subset 




66 






66 












Oi 








10 Subtraction 


70 


49 


47 


41 




33 








45 


37 


38 


43 




Area: Division 






























11 Denominator 


74 




69 














72 




31 






12 Division 


66 


47 


47 


38 












47 


35 




41 


33 


13 Factor 


55 


38 








60 












62 






14 Fraction 


70 


38 


o7 














68 


35 








15 Mixed Fraction 


62 


55 


49 




31 






34 




52 


53 








16 Multiplication 


64 


42 


51 


34 










35 


49 


31 




37 


33 


17 Numerator 


73 


31 


67 














63 










18 Product 


72 


38 


43 






55 








40 


34 


65 






19 Quotient 


65 


41 


A O 

43 






33 






44 


42 


41 




33 


20 Remainder 


61 


48 


42 






32 








41 


36 


34 


33 


32 


Area: Expressing 






























Relationships 






























21 Average 


49 


39 












48 




32 


43 


42 






22 Graph 


54 


43 


39 


39 












39 






43 




23 Measurement 


63 


48 


43 














45 


41 


31 






24 Open Sentence 


48 


52 


33 








44 






35 


44 








25 Place Holder 


59; 


54 


35 


32 










44 


34 


38 




36 


52 


26 Place Value 


42 


64 






43 








. 38 




58 






33 


27 Solution Set 


45 


64 






38 








31 




58 






39 


28 Standard Unit ^ 


60 


46 


42 








33 






41 


35 


31 


37 




29 Statement 


61 


49 


37 


31 










42 


39 


38 




37 


34 


30 Weight 


59 


53 


35 


49 










31 


37 


40 




50 





Includes those variables which have coefficients greater than .30 (absolute). 



Decimals have been omitted. 
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Appendix C 
Orthogonal Common Factor Results for 
Mathematics Concepts: Girk^ 



Alpha Harris R-S ^ UMLFA 

Concept A-1 A-2 H-1 H-2 H-3 H-4 H-5 H-6 H-7 U-1 U-2 U-3 

Area; Set Theory 



1 


Disjoint Sets 


54 


40 


41 












38 


34 


44 


2 


Empty Set 


55 


58 


40 


36 










42 


46 


50 


3 


Equal Sets 


54 


53 




38 




34 






50 


45 


34 


4 


Equivalent Sets 


49 


49 


57 














33 


72 


5 


Line 


38 


58 




32 








48 


37 


47 


33 


6 


Parallel Lines 


47 


39 








58 






46 




32 


7 


Plane 


37 


49 










51 




41 


40 




8 


Point 


46 


61 




37 






35 




44 


50 


36 


9 


Subset 


64 




41 




36 








51 




38 


10 


Subtraction 


65 


45 






34 


44 






57 


34 


43 




Division 
























11 


Denominator 




71 




64 












72 




12 


Division 


56 


49 








32 






50 


41 


37 


13 


Factor 


59 








63 








65 






14 


Fraction 


41 


67 


34 


58 












62 


45 


15 


Mixed Fraction 


42 


70 


32 


49 










36 


6], 


42 


16 


Multiplication 


62 


35 






48 








. 63 






17 


Numerator 




65 




68 












67 




18 


Product 


60 


44 






46 








58 


37 


32 


19 


Quotient 


58 


40 






44 








53 


31 


36 


20 


Remainder 


. 59 


42 


41 












45 


31 


49 


3a: 


Expressing 


























Relationships 
























21 


Average 


55 
















44 




31 


22 


Graph 


45 


38 










45 




39 


31 


31 


23 


Measurement 


53 


43 


53 












35 




57 


24 


Open Sentence 


46 


45 












51 


47 


41 




25 


Place Holder 


54 


44 


51 










34 


44 




46 


26 


Place Value 


60 


38 


57 




31 








45 




50 


27 


Solution Set 


55 


51 


. 38 


35 










50 


42 


38 


28 


Standard Unit 


58 


41 


37 








34 




47 


32 


42 


29 


Statement 


. 51 


55 




33 




39 






49 


45 


36 


30 


Weight 


36 


65 


31 


38 






31 


32 


32 


50 


42 



a Includes those variables which have coefficients greater than .30 (absolute). 
Decimals have been omitted. 



Appendix D 
Orthogonal Conunon Factor Results for 
Mathematics Tasks: Boys^ 







Alpha 


Harris R- 


-S2 


UMLFA 




Task 


A-1 


H-1 


H-2 H-3 


U-1 


1 


Given name of attribute » select example. 


90 


73 


43 


34 


91 


2 


Given example of attribute, select name. 


91 


75 


47 




91 


3 


Given. name of concept » select example. 


89 


75 


45 




90 


4 


Given name of concept » select nonexamplc. 


84 


72 


44 




84 


5 


Given example of concept, select name. 


91 


74 


49 




91 


6 


Given concept, select relevant_attribute. 


91 


63 


58 




91 


7 


Given concept, select irrelevant attribute. 


72 


36 


69 




72 


8 


Given definition of concept, select name. 


92 


64 


56 


36 


92 


9 


Given name of concept, select definition. 


89 


62 


53 


41 


90 


10 


Given concept, select supraordinate concept. 


87 


67 


53 




87 


11 


Given concept, select subordinate concept. 


86 


61 


59 




85 


12 


Given two concepts, select relationship. 


78 


48 


59 




77 . 



a Includes those variables which have coefficients greater than .30 (absolute). 



Decimals have been omitted. 



Appendix E 
Orthogonal Conunon Factor Results for 
Mathematics Tasks: Girls ^ 



Alpha Harris R->S 2 UMLFA 





Task 


A-1 


H-1 


H-2 


U-1 


U-2 


1 


Given name of attribute » select example. 


87 


80 


40 


84 


36 


2 


Given example of attribute* select name. 


89 


77 


44 


79 


45 


3 


Given name of concept » select example . 


88 


72 


52 


73 


50 


4 


Given name of concept » select nonexample. 


82 


73 


40 


71 


44 


5 


Given (example of concept* select name. 


88 


70 


50 


69 


54 


6 


Given concept, select relevant attribute. 


89 


67 


58 


66 


60 • 


7 


Given concept, select irrelevant attribute. 


63 


31 


63 


31 


63 


8 


Given definition of concept, select name. 


91 


72 


54 


70 


59 


9 


Given name of concept, select definition. 


88 


73 


49 


72 


52 


10 


Given concept, select supraordinate concept. 


85 


62 


54 


63 


57 


11 


Given concept, select subordinate concept. 


83 


64 


48 


65 


51 


12 


Given two concepts , select relationship. 


75 


42 


66 


41. 


69 



d Includes those variables. which have coefficients greater than .30 (absolute). 



Decimals have been omitted.' 



o^o a27<-oao-a. 
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